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Abstract. Let T> = G/K be a complex bounded symmetric domain of tube type in a complex 
Jordan algebra V and let Z>r = H/L C T> be its real form in a formally real Euclidean Jordan 
algebra J C V. We consider representations of H that are gotten by the generalized Segal- 
Bargmann transform from a unitary G-space of holomorphic functions on T> to an L 2 -space on 
Dr. We prove that in the unbounded realization the inverse of the unitary part of the restriction 
map is actually the Laplace transform. We find the extension to T> of the spherical functions on 2% 
and find the expansion in terms of the L-spherical polynomials on T>, which are Jack symmetric 
polynomials. We prove that the coefficients are orthogonal polynomials in an L 2 -space, the measure 
being the Harish-Chandra Plancherel measure multiplied by the symbol of the Berezin transform. 
We prove the difference equation and recurrence relation for those polynomials by considering the 
action of the Lie algebra and the Cayley transform on the polynomials on T>. 



1. Introduction 

The study of various generalizations of the classical Weyl transform has attracted much interest 
and has been pursued for some time. As is well-known the Weyl transform maps unitarily from 
the L 2 -space on C™ = R 2n onto the space of Hilbert-Schmidt operators on Fock-space, .F(C n ), on 
C". The Weyl transform intertwines the natural actions of the Heisenberg group, H n =IxC" 
and realizes the decomposition of L 2 {H n ). However, there is another model for the representation, 
namely, the so-called Schrodinger model, and the Segal-Bargmann transform is then a unitary map 
from the Schrodinger model to the Fock model intertwining the action of the Heisenberg group. 
The Segal-Bargmann and Weyl transforms have been studied for a long time in its connection 
with geometric quantization. But somewhat surprisingly their unitary properties have not been 
satisfactorily clarified. The unifying idea is the restriction principle, i.e. polarization of a suitable 
restriction map([p"8|, Jl9|). This idea, in turn, also unifies the so-called Wick quantization and Berezin 
transform in one picture, which we briefly recall. 

Consider the tensor product F{C n ) ® J r (C n ) realized as the space of Hilbert-Schmidt operators 
with integral kernels F(z,w) holomorphic in z and anti-holomorphic in w. Imbed C n into CxC , 
bar denoting opposite complex structure, by z ^ (z,z). Consider the restriction mapping from 
!F(C n ) <g> JF(C") to real analytic functions on C™ taking functions F(z,w) to its restriction F(z,z). 
By taking a multiplier of the Gaussian (which is the restriction of the reproducing kernel of J r (C n )) 
into account one gets a bounded injective map R : !F(C n ) ® J-(C n ) — > L 2 (C n ) with dense image. 
It turns out that the adjoint R* is the Wick quantization map. Consider the polar decomposition 
R* = UVRR*. The map U is the Weyl quantization and RR* is the Berezin transform. Thus the 
information about the Wick quantization, the Weyl quantization, and the Berezin transform are 
encoded in the restriction map. 

It is easy to see by a similar calculation, as in , that by restriction of the Fock space on C™ to 
its real form and taking the unitary part of the restriction we get the Bargmann-Segal transform. 
The Weyl transform from L 2 (C n ) = L 2 (R") <g> L 2 (R n ) onto T(C n ) ®f(C n ) is the tensor product of 
two Bargmann-Segal transforms, obtained by considering the restriction to two different real forms. 
The point is then that both transforms may be considered as the unitary part of the adjoint of the 
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restriction of certain holomorphic representations on various real forms of the underlying complex 
manifolds. 

Instead of a flat complex space C™ we may take a bounded symmetric domain T> = G/K and 
consider the tensor product of a weighted Bergman space (so called holomorphic discrete series of G) 
with its conjugate. One may then perform the polar decomposition R* = UyRR* of the restriction 
map R and get a unitary intertwining operator U from the tensor product onto L 2 (D). In terms of 
representation language this has been studied by Repka [Q, and an analytic and explicit approach 
was started in |p9| . In particular, it is realized that the analytic issues are far more subtle when one 
considers the tensor product of the analytic continuation of weighted Bergman spaces For 
that purpose we need to understand the positive part in the polar decomposition, namely the square 
root of the Berezin transform RR* . The Berezin transform in the case of weighted Bergman spaces is 
a positive bounded operator on L 2 (T>) and its symbol has been calculated by Unterberger-Upmeier 
& 

In [ fl8| , it is shown how to generalize those ideas to restriction maps from a reproducing Hilbert 
space of holomorphic function on a complex manifold Mc to a totally real submanifold M. A 
particular situation is when Mc = G/K is a bounded symmetric domain, the Hilbert space .F(C n ) is 
replaced by a weighted Bergman space, and M = Hj HC\K is a totally real homogeneous submanifold. 
The restriction principle gives a natural way to define a Segal-Bargmann and Berezin transform. The 
symbol of the Berezin transform is then calculated in p^j. The same result for real tube domains 
and for classical domains are obtained by van Dijk and Pevner |5| and, respectively, Neretin |l6| . 

In this paper we will use these ideas to construct and study a natural class of functions and 
orthogonal polynomials on real symmetric domains. We consider the simplest case when the real 
symmetric domain is, in the Siegel domain realization, the symmetric cone (Type A in terms of the 
classification of the root system, see |3^] ) . The starting point is a unitary highest weight represen- 
tation (TTvjTii,), with one dimensional minimal K-type, of the group G. We consider the restriction 
map to a real form H/HPiK corresponding to the symmetric cone, both for the bounded realization 
and the unbounded realization of G/K. The main difference is, that in the bounded realization we 
include the multiplier corresponding to the minimal i-T-type in our restriction map 

R:H U ^ L 2 (H/HnK), f » D v f\ H/HnK , 

whereas in the unbounded realization we include this multiplier in the measure, so that the map 
R : 7i v — > L 2 (il, g?/i„) is now just the restriction / i— > /|n. Then in the unbounded realization the 



Segal-Bargmann transform turns out to be the Laplace transform (see Theorem 7.4). Considering 
the unitary image of an orthogonal set of i'C-finite H n -fT-invariant vectors in the holomorphic 
realization we construct a family of spherical orthogonal functions and polynomials on H/H n K. 
Our main result is the orthogonality relations, recurrence formulas and difference formulas for the 
polynomials. In the unbounded realization we get functions of the form u> t— * e~ Tr ^^L l/ (2w) where 
L v is a polynomial which agrees with the Laguerre polynomials in the case where G = SL(2, K) 
and H/H n K ~ M + (H). These polynomials have also been considered in Q, Chapter XV, but 
here we relate them to representatio ns o f G. In that way we derive differential equations satisfied 
by these polynomials (see Theorem ( |7.9| )). Furthermore, applying the spherical Fourier transform 
we get an orthonormal basis of L 2 (a *, |c( A)|~ 2 d\) w and a family of orthogonal polynomials on a* 
(see Corollary ([0]) and Proposition ( |4.3|) ). We der ive recurrence formulas and difference formulas 



for these polynomials (see Theorems (|5.6| ) and (6.1)) 



We mention that a large class of symmetric and non-symmetric polynomials satisfying various 
difference equations has been recently introduced by using the representation theory of affine Hecke 
algebras. However, as it is noted by Cherednik (||, p. 484) the meaning of the difference equations 
needs to be clarified. Our results provide the clarification and meaning of the orthogonality and 
difference relations for these orthogonal polynomials. It also reveals that the difference relations and 
the recurrence relations are somewhat dual to each other. We may well expect that this will be true 
for other types of Macdonald polynomials. 

This joint project started in December 2000 as G. Zhang was visiting the Louisiana State Uni- 
versity. In our discussions we realized that we were working on similar problems using similar ideas, 
except that G. Zhang was working in the bounded realization for all real tube domains, while the 
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first two authors were working on the restriction to the symmetric cone (Type A case) of unbounded 
realizations of Siegel domains. The analytic nature involved for the Type A case is somewhat richer, 
in particular in its connection with the Laplace transform. The treatment of types C and D requires 
however some different and more combinatorial methods, sec pl| . 

Acknowledgement. We would like to thank Hjalmar Rosengren for bringing the paper [p| to our 
attention. The third author would also like to thank NSF for partially supporting his visit to LSU 
in December 2000. 

2. Bounded symmetric domains, symmetric cones and Cayley transform 

In this section we recall some known necessary background about bounded symmetric domains. 
We follow the presentation in (l3) ; see also |tJ . 

2.1. Bounded symmetric domains. Let V be a ci-dimensional complex Hermitian simple Jordan 
algebra. Let T> C V be an irreducible bounded symmetric domain isomorphic to a tube type domain 
in V. Let Aut(X>) be the group of all biholomorphic automorphisms of T>, let G = Aut(2?) be the 
connected component of the identity in Aut(X>), and let K be the isotropy subgroup of G at the 
point 0. Then G is semisimple and, as a Hermitian symmetric space, T> = G/K. Furthermore, K 
is a maximal compact subgroup of G. We denote by G the connected simply connected covering 
group of G and K the pre-image of K in G. Then K ~ K x K\ where K\ is a simply connected 
compact semisimple Lie group. We start by reviewing the basic structure theory of G in terms of 
the structure of the Jordan algebra V. The Lie algebra g of G is identified with the Lie algebra 
aut(2?) of all completely integrable holomorphic vector fields on T> equipped with the Lie product 

[X,Y](z) := X'(z)Y(z) - Y'(z)X(z), X,Y e aut(X>), zeV. 

Define 9 : g — ► g by 9(X)(z) := —X(—z). Then 9 is a Cartan involution on g and 

g e = {X eg\9(X) = X} = t, 



is the Lie algebra of K. Let 



p := {X e g | 9{X) = -X} 



Then g — i p is the Cartan decomposition of g corresponding to 9. Every element in g is given by 
a polynomial of degree at most 2, J27J. The Lie algebra 6c corresponds to the elements of degree one 
and is isomorphic to a subalgebra of End(F) by T i— > (Tz)j^. The identity map thus corresponds 
to the Euler operator 

(2.1) Z :=z%-. 

az 

This element is central in tc and ad(Zo) has eigenvalues ±1 on pc- The + 1-eigenspace p + corresponds 
to the constant polynomials and the —1-eigenspace p _ corresponds to the polynomials of degree two. 
There exists a quadratic form Q : V — * End(V^, V) (where V is the space V but with the opposite 
complex structure), such that 

(2.2) p = {£ v \veV}, where := (v - Q (z) v)%- . 

az 

In the following we will identify elements in g with the corresponding polynomials. Let {z, v, w} 
be the polarization of Q(z)v, i.e., 

{z, v, w} = (Q(z + w) - Q{z) - Q{w))v. 

Then 

(2.3) £ v (z) = v - Q(z)v = v ~ ^{z,v,z}. 

The space V with this triple product on V x V x V, is a JB*-triple; (p7|). Define D : V x V 
End(y) by D{z, v)w = {z, v, w}. The Lie bracket of two elements £ v , £ w S p is then given by 

(2.4) = (D(v,w)-D(w,v))et. 
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The group K acts on V by linear transformations. Furthermore, 

(2.5) z, w I— ► (z I w) := -TrD(z, w) 

P 

is a AT-invariant inner product on V. Here Tr is the trace functional on End(V) and p = p(T>) is 



the genus of V (see (2.8) below). Denote by || • || the corresponding if-invariant operator norm on 



End(V^). Define the spectral norm \ \ ■ | | sp on V by 

IklU :=||^,5)|| 1/2 . 

Then the domain T> is realized as the open unit ball of V with respect to the spectral norm, i.e. 

v = {z e v \ \\z\\ sp < l}. 

An element v £ V is called a tripotent if {v, v, v} — 2v. Let us choose and fix a frame {ej}^ =1 of 
tripotents in V. The number r is called the rank of T>. D efine Hj = D(ej,e~j) £ 6c- The operator 
D(u,u) has real spectrum for each u £ V. Hence, by (2.4), Hj £ it. Furthermore, the subspace 

r 

(2.6) L = i0RHjCl 

j'=i 

is abelian. Let t = t_ ® t+ be a Cartan subalgebra of 6 and g containing t_. Let A(flc, ic) be the 
set of roots of ic in gc- Recall that a root a 6 A is called compact if (flc)c* C tc and non-compact 
if (flc)a C pc- Denote by A c and A n the set of compact, respectively, non-compact roots. Finally, 
we recall that two roots a ^ ±/3 are called strongly orthogonal if a ± j3 $ A(gcitc)- We choose 
7j £ (t*)c so that 

and vanishes on (t+)c- Then {71, . . . , 7 r } is a maximal set of strongly orthogonal non-compact roots. 
We order them so that 

71 > • • • > 7r- 

The element e:=ei + ... + e r isa maximal tripotent and 
(2-7) Z = ±D(e,e) = ±Y,H j , 

r=l 

where corresponds to the identity map as before. In this notation the genus of T> is given by 

(2.8) v = v (v)= 2 -±. 

r 

2.2. Real bounded symmetric domain. Let e = e\ + . . . + e r be the maximal tripotent as before. 
The map r : V — > V, t(v) = Q(e)v is a conjugate linear involution of V and induces a decomposition 
V = J i J, where J is a formally real Euclidean Jordan algebra with identity e. Notice that r 
also defines an involution, also denoted by r, of g and G. The involution on G is simply given by 
[r(g)](z) — T(g(r(z))), for z £ T>. As r commutes with the Cartan involution 9 we have the following 
decomposition of g into eigenspaces: 

= f)©q 

= f)fc © q/c © f) P © q P 

= tfc © 6g © Pfo © Pg, 

where f) is the + I-eigenspace and q is the — 1-eigenspace of r. The index fc indicates intersection 
with 6, etc. The restriction of 9 to f) defines a Cartan involution on f) and the corresponding Cartan 
decomposition is f) = th © Ph- The space p 9 is then a real subspace of p. Recall the definition 
£ v (z) := v — Q(z)v. Then 

Ph = {£v I V £ J}. 

Let 2?r = V H J = 2? T . Then 2?r is a real bounded symmetric domain. For the structure of these 
domains see H] and p3| . Let 

G(P R ) = {.9 e G I 5 (2? R ) = P R } . 
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Then G(2?r) is a closed subgroup of G with finitely many connected components. Let H = G(2?r) q 
be the connected component containing the identity 1 <E G. Since e € 2?r the subgroup {k E K \ 
k ■ e — e] is a maximal compact subgroup of G(2?r) and equals G(2?r) n X. By replacing G(2?r) by 
it follows that H n K is a maximal compact subgroup of H and 

2?r = H/H HK = G(V R )/G(V R ) n X 

is a Riemannian symmetric space with the Bergman metric restricted to T> R . Moreover, it is a totally 
geodesic submanifold. Finally, H = G T Q = {a g G | r(a) = a} Q . Thus (G,H) is a symmetric pair. 
We note that the group _ff is not semisimple since exp(R£ e ) is in the center of H . The group H is 
invariant under the Cartan involution 9 and 6\h is a Cartan involution on H. 

2.3. Cayley transform. In this subsection we discuss the realization of V as a tube type domain 
T(O) = iJ + f2. Let SI be the cone of positive elements in J: 

CI = {x 2 | z g J, dct(x) ^ 0}. 

Then O is a symmetric convex cone. Let 

T(O) = i J + = g V | Re(iu) g 0} . 

If e — z is invertiblc in V let 

(2.9) 7(z) = £±f = (e + z)(e _ z) -i 
be the Cayley transform. Its inverse is 

(2.10) 7 _1 H = (w-e){w + e)- 1 . 
The following is well known: 

Lemma 2.1. Let the notation be as above. Then the following hold: 

1. TTie Cayley transform 7 is a biholomorphic transformation from V into the Siegel domain 
T(fi). 

2. TTie Cayley transform 7 : D h r(f2) maps t/ie rea^ /orm Dr 0/ D onto t/ie reaZ /orm fi of 
T(fi). 

3. TTie following diagram commutes 

i i 
V -U T(Q) 

where the vertical arrows are the inclusion maps. 

Notice that the Cayley transform can be realized by an element, also denoted 7, in Gq- In fact, 
there exists a X g q p such that &d(X) has eigenvalues 0,1, and —1 and 7 = exp(^X). Define 
G 7 := 7G7- 1 and iJ 7 = (K c n G 7 ) c . Then 

(2.11) G 7 (f7) D = {.g g G 7 I s (fi) = 0} = ff 7 = 7 J ff 7 " 1 . 

Let 7 := Ad(7)(fl) be the Lie algebra of G 7 . We collect some important facts in the following 
lemmas: 

Lemma 2.2. Let the notation be as above. Then the following holds: 

(2.12) g 7 = f) fe + it) p + iq k + q P 

Thus (g 7 , V = t)k + if) p , f) 7 = f)fc + *1fe) is the Riemannian dual of (g, 6, f)). 
Lemma 2.3. Mtft notation as above we have 

f) 7 = 6c H g 7 and Z is central in'ip . 
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We refer to for further information. The group G 7 acts on T(f2) by transforming the action 
of G: 

g-z = 7((7 _1 37) ' (7 -1 (*)))- 
For simplicity we will sometimes write 7 for the adjoint action of 7 on qc and the conjugation with 

7 in Gc- 

2.4. Roots. In this subsection we describe the structure of restricted roots for the group H. Let 
& = and 

£ = & + ••• + £ r 
By SU(1, l)-reduction we have the following: 

Lemma 2.4. = Ad( 7 )- 1 (iJ 3 ) and £ = 2Ad( 7 )- 1 (Z ) = -Ad( 7 )(2Z ). 
Let 

r 

a = ©Rfc, 
4=1 

and define /3j € a* by = 2^. Then o is maximal abelian in f) p . In fact, o is also maximal 

abelian in p. We remark that ~f 2 Hj = —Hj, 7(t-) = 7~ 1 (t_) = a and (3j = 7, o Ad(7). 

We will often identify with C r using the map a i— >a = + . . . + a r p r . The root system 
A(rj, a) is of type A: 

A(M = ±{^-^|l<j^<r 
We fix an ordering of the roots so that 

Pi > 02 > ■ ■ ■ > r . 
Then the corresponding system A + = A + (f), a) of positive roots is given by 



A 



+ ={^\i<j<k< r y 



The root spaces i)(p -p h )/2 au have the same dimension which we denote by a. Then the half sum 
of the positive roots is 

r r 

(2-13) p = J2Pifo = ^E(( r + !) - 2 fifo- 

4=1 4=1 

Example 2.5. In the case of T> = {z E C | |z| < 1} and G — SU(1, 1) acting on T> in the usual way 

a P \ az + P 

1 z — 



our notation is: 



2Z = Hi 



P a J Pz + a 



1 

-1 



1/1 1 \ fm ( -i 



1 

1 

23r = (-1,1), 
J = M, 

n = R+ , 

T(fi) ={zeC| Re(z) > 0} 
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2.5. Conical functions, spherical functions, and invariant polynomials. Let {ej}^ =1 be the 

fixed frame as before. Let Uj := Ylk=i efc ' 3 = ^-i' ' ' i 7 *- Let Vj := {z e V \ D(iij,Uj)z = 2z}. Then 
Vj is a Jordan *-subalgebra of V with a determinant polynomial denoted by Aj . We extend Aj to all 
of V via Aj (z) := Aj(pr v . (z)), where pr^ is the orthogonal projection onto Vj. The polynomials Aj 
are called (principal) minors. Notice that A r (w) = A(w) = det(w). For any a — (a±, • • • , a r ) € C 
consider the associated conical function (JtJ, p. 122): 

A Q H := A^- a2 (w)A^- a3 (w)---A^(w), we V. 

Notice that if w = X)j=i w j e j th cn A a (w) = Ilj=i w< j 3 ■ Thus the conical functions are general- 
izations of the power functions. 

Let L := H n K C G n G 7 and define 

(2.14) ^a(z) := y A a (lz)dl, zeV 

The function "0A+p is the spherical function on £1 corresponding to A Theorem XIV. 3.1). 
We identify (tl)c with C r via mi7i + . . . + m r ^ r <-> (mi, . . . , m r ) € C' r . If A = m, where m = 
(mi, . . . , m r ) is a tuple of non-negative integers such that mi > ni2 > •• • > m r > 0, then the 
functions A\ and ^ are holomorphic polynomials on the whole space V and is L-invariant. Let 
V(V) be the space of holomorphic polynomials on V, considered as if-space by the regular action, 
k ■ p(z) = p(k^ 1 ■ z). Let 

(2.15) A = {m € % | mi > m 2 > . . • > m r > 0} . 

Then we have the well known Schmid decomposition (J24| and 0, Theorem XI.2.4). 
Lemma 2.6. The space of polynomials V(V) decomposes as a K -representation into 
(2-16) V{V) = ]T V m , 

mGA 

where each V m is of lowest weight — m = —(mi 71 + • • • + m r 7 r ), wii/i mi > • • • > m r > 6emg 
integers. In this case the polynomial A m is a lowest weight vector in P m and ip m is up to constants 
the unique L-invariant polynomials in V m . In particular 

(2.17) T(V) L = c ^m- 

As ip\+p is spherical on Q and because the Cayley transform commutes with the L-action we get 
the following lemma. 

Lemma 2.7. Let A € a£. Then the spherical function <j)\{x) on the real bounded symmetric domain 
2?r is given by 



4>\(x) = i^ix+p y e _ x J = i>i\+ P 70*0 ) xeV R . 

2.6. The T-function on symmetric cones. The //"-invariant measure on O is given by 

d/j,o = A(x)~~dx, 

where d = dirriK(J) = dimc(U). The Gindikin-Koecher Gamma function associated with the convex, 
symmetric cone Q is defined by 

r n (A) := / e- Tr ^A x (x)A(x)- d / r dx, 
J a 

The integral converges if and only if Re(A i ) > (j-l)a/2for j = 1,2,- •• ,r, (@, Theorem VII. 1.1.). 
Moreover, the convergence is absolute and uniform on compact subsets of C™ . Using the identification 
with C™ via the map (Ai, . . . , A„) <-> Ai/3i + • • • A„/3„ we have 

r n (\) = (2^f[r(\j-(j-i)~), 

3=1 



s 
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where T is the usual Gamma function. In particular, it follows that Tq has a meromorphic contin- 
uation to all of a£. We will view Tq as a function on C and on using our identification above. 
We also adopt the notation /3 = J2]=i Pj an d Tn(u) = Tci{vf3o), where fgC. Finally, we define 

_ r (A + m) 

(A) - ~ r n (A) ■ 

2.7. The Laplace transform. We recall here a few facts about the Laplace transform on f2. Let 
H be a (complex) Radon measure on Q such that x h- > e _ '*' x - ) G L 1 (il, dH) f° r au i G fi. Define the 
Laplace transform of fi by 



Jn Jn 

for w = t + is € T(f2). Then is holomorphic on T(f2). In particular, if / S L 1 (f2, d/i) then 

f(x)dfi is a finite measure and hence £(/) := C(fdfi) is well defined. Furthermore, if f £ C is such 
that Re(i/) > (r- l)f let d/z„(a;) = A(x) ,y - d/r dx. Notice that A u _ d/r (x) = A(xY~ d/r . Then d^„ 
is a quasi-invariant measure on fl and the £f-invariant measure corresponds to dfi Q . If v > is real, 
then we let 

(2.18) Ll(fl) = L 2 {n,dnu). 
We define £„ : L^(fi) -► 0(T(fi)) by 

£„(/)(*) = C(fdn v )(z) = f e- (z ^f(x) dfiu(x), , z e T(n) 

Here 0(T(O) denotes the space of holomorphic functions on T(Q). We notice the following which 
follows directly from Proposition VII. 1.2 of 0, p. 124 by the holomorphicity of both sides in w: 

Lemma 2.8. Let v € C be such that Re(v) > (r — 1)|. Then for any w E T(fl) 

%)W = r fi ( ! /)AW-". 

2.8. Unitary highest weight representations. In this subsection we review some simple facts 
on scalar valued unitary highest weight representations. We restrict the discussion to what we will 
need later on. From now on v <— ► v denotes conjugation with respect to the real form J. Let G 7 be 
the universal covering group of G 7 . Then G 7 acts on T(f2) by (g, z) i— ► «;(<?) • z where k : G 7 — > G 7 
is the canonical projection. For f > 1 + a(r — 1) let 7i u (T(Q)) be the space of holomorphic functions 
F : T(f2) -> C such that 

(2.19) \\ F \\l:=a v ( |F(x + iy)\ 2 A{y) v ~ 2d l r dxdy < oo 

Jt(P) 

where 

(47r) ci rn(^ - d/r) 

Then H V (T(Q)) is a non-trivial Hilbert space. For v < 1 + a(r — 1) this space reduces to {0}. If 
v = 2d/r this is the Bergman space. For g G G 7 and z € T(Cl), let J g (z) = J(g,z) be the complex 
Jacobian determinant of the action of G 7 on T(S1) at the point z. We will use the same notation for 
elements g € G and zgD. Then 

J(afr, z) = J(a, 6 • z)J(b, z) 
for all a, 6 G G 7 and z £ T(f2). It is well known that for > 1 + a(r — 1) that 
(2-21) n v (g)f(z) = J(g- 1 ,zy/*f(g- 1 -z) 

defines a unitary irreducible representation of G 7 . In |^3| , ]2£| and j(| it was shown that this unitary 
representation (7r„, 7i„(T(f2))) has an analytic contin uatio n to the half-interval v > (r — Here 
the representation 7r„ is given by the same formula (2.21) but the formula for the norm in (2.19) 
is no longer valid. We collect the necessary information from |tJ, p. 260, in particular, Theorem 
XIII. 1.1. and Proposition XIII. 1.2., in the following theorem. We will give a new proof of (4) later 
using only part (3). 
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Theorem 2.9. Let the notation be as above. Assume that for v > 1 + a(r — 1) then the following 
hold: 

1. The space Ti u (T(Q)) is a reproducing Hilbert space. 

2. The reproducing kernel o/W„(T(f2)) is given by 

K v {z,w) =T n {v)A(z + u>y u 

3. If v > (r — 1)# t/ien i/iere exists a Hilbert space Tt v (T(Q)) of holomorphic functions on T(f2) 
such that K u (z, w) defined in (2) is the reproducing kernel of that Hilbert space. The group G 7 
acts unitarily on 7i u (T(Q)) by the action defined in (2.21). 

4. The map 

L 2 v (Sl) 9 /-> F = £„(/) e W„(T(fi)) 

is a unitary isomorphism and 

5. If v > (r — 1)^ then the functions 

qm,u{z) := A(z + e)' u ip m (~^~) > m e A, 

form an orthogonal basis of H. u (T(tt)) L , the space of L-invariant functions inW„(T(fl)), 

2.9. Weighted Bergman spaces on the bounded symmetric domain. In the last section 
we concentrated on the unbounded realization. We will now shift our attention to the bounded 
realization T>. Let 

(2.22) h(z,w) := A(e-zw). 

We note the h(z, w)~ p is the Bergman kernel on T>. We collect a few well known facts about h(z, w) 
in the following lemma. 

Lemma 2.10. Let g G G and z,w G T>. Then the following hold: 

1. h(z,w) is holomorphic in the first variable and anti-holomorphic in the second variable. 

2. h(w, z) — h(z, w) for all z, w G T> . 



3. h(g-z,g-w) = J{g^z) 1 / p J{g 1 w) 1 / p h(z,w). In particular, h(z,z) = |J(g, 0)| 2 / p > where 
g G G is chosen such that g ■ = z. 

4. If x,y G £>k then h{x,y) > 0. In particular, all powers h{x,y)^, fi G K, x,y G 2>r, are well 
defined. 

Let h(z) = h(z, z) = A(e — zz). Then the measure 

(2.23) dm v {z) = h( z y- p dz 

is a quasi-invariant measure on T> and dmo(z) is invariant. Furthermore, 

(2.24) dn(x) = h(x)- p/2 dx 

is an ii-invariant measure on 27r. Let G be the universal covering group for G. As for T(f2) there 
exists a Hilbert space 7i j, (I?) of holomorphic functions T> with a unitary G-action, given by 

^(g)f(z) = J(g-\z^f(g- 1 z) 

if v > (r — l)a/2. Here z i— > J(g, z) is again the Jacobian of the action of GonV. If v > 1 + a(r — 1) 
then the norm on T-L V {T>) is given by 

(2.25) \\F\\l = \\F\\ 2 Hv{T)) := d v f \F(z)\ 2 dm v (z) 
where 

1 T a {y) 



ir d T n { V -d/r)- 

The constant d v is chosen so that the constant function z t— > 1 has norm one. 
Lemma 2.11. Let the notation be as above. Then the following hold: 
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1. If F G 7i, y (T(f2)) then the function 

tt 1/ ( 7 - 1 )(F)H = 2^ A(e - w)~ v F o 1 {w) = A(e - w)~ v F((e + w){e- w)' 1 ) 
belongs to Ti v (T>) and 

tt^- 1 ) :H v (T n )^H u (D) 

is a linear isomorphism onto H U (T>). 

2. The inverse ^(7) : H^(T>) — > 7i v {T(Vl)) is given by 

7T,, (7) (F)(2) = 2^ A (z + e)- v F o 7 - 1 ( z ) = 2* A (z + e)~" F((z - e)(z + e)- 1 ) 

3. Let F e Ti u {T(VL)) then 

\\^- 1 )(mH A v)=^)\\F\\L(nn ) ) 

4. IfgeGandFe U V {V) then 

7T v ( 7 )(7T u (g)F) = ^(igi-^.mF) . 

5. Ifv>{r- l)f then P(V) C W y (X>) and P(V) is dense m H V (V). 

6. If ' v > (r — 1)§ i/ien i/ie functions ijj m , m e A, /orm an orthogonal basis for TL V {T>) 



L 



Proof. That the map is an isomorphism follows from [Q, Proposition XIII, 1.3. The intertwining 
relation in property (4) is a simple calculation and is left to the reader. □ 

In particular, it follows that (@], Proposition XIII. 1.4): 
Lemma 2.12. The reproducing kernel of7i v (T>) is given by K v {z,w) — h(z,w)~ u — A(e — zw)~" . 
Define the Fock-space on V to be the space of holomorphic functions on V such that 

(2.26) \\F\\%<y) = ^ J v \F(z)\ 2 e~^ 2 dz < 00 . 

The following result is proved by Faraut and Koranyi ||, see also 0, Proposition XI. 4.1 and Propo- 
sition XIII. 2. 2. This will play an essential role in our work. 

Theorem 2.13. Assume that v > 1 + a(r — 1) and m > 0. Then the norms ofip m in the Fock-space 
and weighted Bergman spaces are given by 

1 (d 



|lM&(V) - - d , r 



and 



1 (-) 

\ r / 1 



ln " {V) ~ d m („)» 
respectively, where d m is the dimension of the space P m . 

Corollary 2.14. Assume that v > 1 + a(r — 1). Then the functions 



d m (v) m 
rk "0m , m e A 



V (-) 

form an orthonormal basis for Ti u {'D) L . 

Proof. This follows from Lemma |2.1l| , part 6, and the above Theorem. □ 
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3. Berezin transform and generalized Segal-Bargmann TRANSFORM FOR Vm 

3.1. Restriction to D of holomorphic functions on T>. In this subsection we discuss the re- 
striction principle for the bounded symmetric space 2?r, (pTj, pi |3^ |) . In particular, we give an 
exact bound for the parameter v such that the restriction map R, defined below, maps V(V) into 
L\H/L). 

Recall that the TJ-invariant measure on 2?r is given by drj(x) = h(x) ^dx. The group H acts 
unitarily on L 2 (T>R,dr]) by g ■ f(x) = f(g~ x ■ x). Furthermore, 

L 2 (2?k, drj) ~ H L 2 (H/L,dh) 

where dh denotes an ff-invariant measure on H/L. 

Lemma 3.1. Let cel. Then p(x)h(x) u / 2 e L 2 (D R , drf) , for all p e V{V), if and only if v > 

a(r-l) 
2 

Proof. Let p S V(V). As the closure of 2?r is compact it follows that p is bounded on 2>r. Hence it 
is enough to show that h v l 2 £ L 2 (2?r, drf) if and only if v > (r — 1)|. Note that /W 2 is L-invariant. 
Writing the invariant measure on H/L using polar-coordinates gives for every L-invariant function: 

f f(h ■ 0)dh = f /(exp(V t&) 0) [TT sinh(t 4 - 1,-) j dt x . . . dt r . 



' H/L Jti>t 2 > — >t 

If G = SU(1,1) then a = f J J V Then 

:= exp(^i) 

and hence 



i=i \*<J 



cosh(t) sinh(t) 
— sinh(i) cosh(f) 



g t ■ = tanh(i) 
A similar calculation in the general case gives: 

r r 

3=1 i=i 



Thus 



/i(exp(^^) • 0) = A(e - tanh 2 (< J )e i ) 

3=1 3=1 
r 

= JJ(1 - tanh 2 (t,)) 

3=1 
r 

=n 



L Ji cosh 2 (tj) 



It follows that 



[ \h{x) u/2 \ 2 h(x)- p / 2 dx = f TT cosh^)- 2 " [ JTsinhfo -tj) ] dti.-.d^. 

•/*!>.. .>*r i=1 ' y,^ y 

Let ^(t) = — an d observe that </> is non-negative and increasing, <^(f) = if and only if t = 0, 
is bounded (by |) on [0, oo), and sinh(ii — t 3 -) = e li ~ tj <p(ti — tj). In a similar way let ip(t) — i±| — . 
Observe that ^>(t) € (|, 1], for all t € [0, oo), and cosh(tj) = e tj ip(tj). Let i = (ii, . . . , t r ) and define 
<!>(£) = IIj <;7 -0(tj — ij) and = IK =1 T/;(tj-). In this notation we have 

f \h{xy/ 2 \ 2 h{x)- p/2 dx = f <P(t)^(t)e^-^- 2v+ir+1 - 2 ^ a ^ dh . . .dt r . 

Jv u Jt 1 >...>t r 
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Now suppose v > (r — 1)|. Then — 2v + (r + 1 — 2j)a < for each j = 1, . . . r. Since \& and $ 
are bounded the integral converges. On the other hand, suppose the integral converges. Let e > 0. 
Then the integral converges when integrated over the complement of the set where ti — tj < e, for 
all i,j such that 1 < i < j < r. Since $ and are bounded away from zero on such a set it must 
be that -2v + (r + 1 - 2j)a < for each j = 1, . . . r. This implies v > (r — l)f . □ 

We remark that the constant in the last lemma is exactly the same as the endpoint of the 
continuous set of parameters, (%(r — l),oo), for the unitary highest weight modules. Assume that 
v > (r — 1)|. Let R v be the restriction map R v : TL V {V) — > C°°(2?k) given by 

(3.1) R v f(x)=f(x)h(x)%. 

As v will be fixed most of the time, we will often write R for R v . Consider the restriction of the 
group action -k v of G to H, where H is the subgroup corresponding to the Lie algebra f). Using the 
method from []l7|| , Lemma 3.4, we can now prove the following lemma. 

Lemma 3.2. Assume that v > (r—\)%. Then the map R v is a closed densely defined H -intertwining 
operator from 7^(2?) into L 2 (2?r, dr)). 

Proof. That R intertwines the action of H on Ti v (T>) and the regular action of H on L 2 (T>,dri) 
foll ows by the transformation properties of h(x). If F is a polynomial, RF £ L 2 (2?r, drj) by Lemma 
3.1. Hence R is densely defined. Let g £ C^°(2?e) and e > 0. Then there exists a polynomial F such 
that \\F - h-'PgWao < e/\\h"/ 2 \\. Hence 

\\RF~g\\ 2 = f \h{xY\F{x)-h{x)-^ 2 g{x)\ 2 dr } {x) 

^2 



Hence Im(i?) is dense in L 2 (2?k, drj) . Finally, R is closed because point evaluations in TL U (T>) are 
continuous. □ 

We can now consider the adjoint R* : L 2 (2?r, drj) — > iJ„(2?) as a densely defined operator. 

Theorem 3.3. Assume that v > (r — 1)^. Let f be in the domain of definition of R*. Then the 
following holds: 



f(x)dr](x) 



h(y,xY 

2. If g £ H, then this is the same as 

RuKf(3-0)= [ J(fr 1 g,Oy'*f(h)dh = D v *f(g), 

where D v (h) — J{h, Q) v / p is in L 2 (H/L, dh) and D v * f stands for the group convolution. 

3. Assume that v > (r — l)a. Then D v £ L (T>^,dr]). 

4. If v > (r — l)a. Then R V R* V : L 2 {T>^dr\) — > L 2 (T>^,dr]) is continuous with norm \\R V R*\\ < 

5. If v > (r — l)a. TTien R V R* V : L°° (T>r, drj) — ► L°° (T>]g,, drj) is continuous with norm ||i?„i?*|| < 

Proof. (1) Let / be in the domain of definition of i?*. Then R* f £ 7i„(2?) and for u> € 2? we get: 

R*f(w) = (R*f,h(;w)-")n„(v) 
= (f,R(h(;w)-n)mv s} 

f{x)h(x) u/2 h(w,x)- l/ drj(x), 



where we have used that h(z, w) = h(w, z) (c.f. Lemma 2.10| ). Thus for y £ T>r we get: 
RR*f(y)= I f(x)h( y y/ 2 h(xy/ 2 h(y,x)-» d V (x) 



p.. 
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which proves the first statement. 

(2) Let <7i, <72 € H. According to Lemma f2.10| we have 

h(g-0)=h(g-0,g-0) = J(g -0,0) 2 ^. 

Thus 

h(gi ■ 0, 52 • 0) = h(g 2 g^ 1 g 1 ■ 0,g 2 ■ 0) = J(<7 2 , feV • O) 1 ^ J( ff2 , 0) 1 ^, 

where we have used that J(g2,0) and J(<?i,0) are real, and that h(z,0) = 1 for all z. The cocycle 
relation J(ab, z) = J(a, bz)J(b, z) gives 

J( ff i,0) = JO/aG/^iJ.O) = J(ft»,$a V0)JGfe V,0). 

Hence 

J(92,g2 1 9i ■ 0) = J( 5 i,0)J( fc - 1 5l ,0)- 1 . 
Thus the integral kernel for becomes 

ft(gi ■ O)"/ 2 /!^ ■ 0T /2 = J( gl ,0)^J(g 2 ,0)-/P 

%i -0,92 -Or J(g ll 0r/PJ(g 2 1 g 1 ,0y-/PJ(g 2 ,0r/p 
= J{92 1 9i,W P = D v {gz 1 gx) 

As D v (g) = J{g, 0) ly/p = h(g • Of /2 it follows by Lemma O that A, G L 2 (H/L, dh). 



(3) Notice that D 2 = D^v Hence the claim follows from Lemma 3.1 



(4) and (5) are now obvious. □ 
If v > a(r — 1) then 

RR*l(g-0) = / D u {g- 1 h)dh= \\D V \\ L1 < oo . 

JH 

Since H-D^H^i > we define c v by the relation — = The operator RR* is called the Berezin 

transform on 2?r and B v — c v RR* is called the normalized Berezin transform because B v (\) = 1. 
By theorem ( 3.3) 



B v f(x) = c u I 



h(xy/ 2 h( y y/ 2 1 , 
h{x, y y fiy)dv{y) 



(3 - 2) =Cv L \K*,vY'*? fiy)Mv) 

The space L 2 : (2?r, drj) L is decomposed into a direct integral of principle series representations of 
H via the spherical Fourier transform 



(3-3) /(A) = J r (f)(X) = / f(x)Mx)dr,(x) 

Jt> r 

or, in terms of the spectral decomposition of commuting self-adjoint operators, as a direct integral of 
eigenspaces of the invariant differential operators. The L- invariant eigenfunctions of B u are precisely 
the spherical functions <f)\i A G aj. Thus 

B v 4>\ = b v {X)(j>x. 
The symbol b v is explicitly calculated in |32j. 

3.2. The generalized Segal-Bargmann transform. We assume in this section that v > (j — 1)~ . 
The operator RR* is well defined and by definition positive. We can therefore define a/ RR*. Then 
there exists a partial isometry XJ V such that R* — U^V RR* ■ To simplify notation we will often write 
U for JJv- As R = V RR*U* and Im(i?) is dense it follows that U is actually a unitary isomorphism. 

Definition 3.4. Let v > (r — 1)|. The unitary isomorphism U v : L 2 (T>^,dri) — > H. U (D) is called 
the generalized Segal-Bargmann transform (jig]). 



14 



MARK DAVIDSON, GESTUR OLAFSSON, AND GENKAI ZHANG 



Let W = N / Z l(o) be the Weyl group of a corresponding to the root system A(f),a) and 
let / — > / denote the spherical Fourier transform, Then / i— ► / = T(f) extends to an unitary 
isomorphism 

(3.4) T : L*n, +f « * («•, ^ ^ " 

where 

r(i(Aj - A fc )) r(§ + i(A i -A fe )) 



3(a) = co n 



T(( Pj - Pk )) r(§ + Pi -p fc ) 



is the Harish-Chandra c-function, Co is a constant whose value can be evaluated by using known 
integral formulas (see |3lJ for the case of type C and D domains), and w is the order of the Weyl 
group W. Combining all of this together we now get the following proposition. 

Proposition 3.5. Suppose v > (r — 1)% . Then 

ToUt: H V (V) L -► L 2 (a*, -\c(X)\- 2 dX) w 

w 

is a unitary isomorphism. 

Corollary 3.6. Let the notation be as above. Then the following hold: 

1. If v > (r — 1)S then the functions 

JR7*(V; m ), me A 

form an orthogonal basis for the Hilbert space L 2 (a* /W, \c(X)\~ 2 d\). 

2. If v > 1 + a(r — 1) then the functions 



form an orthonormal basis for the Hilbert space L 2 (a* /W, \c(X)\~ 2 dX). 

Proof. This follows Lemma 2.11 , part 6, and Corollary 2.l4 □ 

Our first main goal of this paper is to identify the functions J-U*^ m and study their analytical 
properties. 



4. Generating functions and orthogonality relations for the Branching 

coefficients 

In this section we derive the orthogonality relations for the branching coefficients. These results 
follow somewhat easily from a general considera tion ([pi) )- In the case where one considers the 
branching rules for the tensor product TL V {V) <g> TL V {V) of G, considered as the restriction of the 
representation of G x G on the diagonal, the branching coefficients, also called the Clebsch-Gordan 
coefficients, are studied in |2{|, jl!| and (30). The results here parallel those obtained there. Thus, 
we will be brief. 

Define p m E T^a*) by the Rodrigue's type formula 

(4.1) p„, m (A) = p m (A) := \\i> m \\- 2 v) i; m (d x )(A(e - x 2 )~ u I 2 <f> x {x))\ x = . 

We can consider the polynomials p m (A) as a generalization of the Hermite polynomials (pl|). 

Lemma 4.1. Consider the expansion of h{x)~ v / 2 4>\{x) = A(e — x 2 )~ u t 2 (f>\(x) in terms of the L- 
invariant polynomials ip m . Then 

(4.2) A(e - x 2 y»/ 2 cb x (x) = ^ Pv , m {X)^ m {x) 

meA 
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Proof. Define P m (A) by 

A(e-x 2 )- v/2 Mx) = E p ™Wi> m (x). 

mGA 

Differentiating both side with respect to tp m (d x ) and setting x — gives 

||^m||^ ( y)Pm(A) = P m (A) (lp m (d x )lp m (x)) \ x=0 = P m (A) || Vm||^(y) • 

Hence the claim. □ 
Lemma 4.2. Assume that v > a(r — 1). Le£ F <E H V {V) L . Then 

t{^pZb*u;{f))(\) = c-^Kixf' 2 HK(F))W • 

Proof. Recall that PP* = Hence, for all / e L 2 (X> E , d-q) L , 

r{RE*f){X)=r{D„){X)F{f){\). 

Furthermore, 

^(A,)(A) = /" D„(h)Mh)dh = c- 1 B v (<f>x)(l) = c- 1 b u (X), 
since 0a (1) = 1. Consequently, 



T{^RPSf) (A) = c„ 5 \/6^A) /(A) . 
Applying this to a function / = U*F, F E 7i v (T>), gives the lemma. □ 

The next proposition states that the polynomials p m (A) can be also obtained via the Segal- 
Bargman transform of i/> m . 

Proposition 4.3. Assume that v > a(r — 1). Then 



F(C/>m)(A) = ^KW\\^ m \\l p u , m (X) 
Proof. Since v > a(r — 1), we have 

h{x)^drj{x) < oo. 



Let C(p) be the convex hull of W ■ p. By the Helgason- Johnson theorem ( Theorem 8.1 of Q, p. 458, 
see also jlO| ), if A e a* + iC(p) then (f>\ is a bounded function on Pr. Thus the integral defining 
B v <j)\ is absolutely convergent and 

r h(xY /2 h(vY /2 

b v m*) = <v / { L Z Mv) dv(y) = K(x)M^) ■ 

We divide by c u h(x) u / 2 . Furthermore, extend HV'mll^Vm, m g A, to an orthonormal basis P n of 
H V {V). Then 

II 

This gives: 

c- 1 b„(\)h(x)-»/ 2 cj> x (x)= f Y. h ^y' 2F ^y)Mv)Fjx)dn(y). 



v 



We now let ip m (d x )\x=o act on both sides. For the left-hand side we use Lemma 4.1. For the right 

4>™\\%. 
IIVwII 



hand side we use the fact that \\ip m \\ u 1 '4'm(d x )F I1 (x)\ x =o — o~mn i when F m is one of the 



IIV'mIL 1 V'm, and otherwise. We thus get 

IIVUW^MAK^A) = "t m "? 2 V) / Hyr^ m {y)My)'i>ii!n. 

That is, 

F(P^ m )(A) = H^lfcVMWA) 
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The claim follows now from Lemma 4.2 as R = V RR* U* . □ 



5. Recurrence formulas for the Branching coefficients 



Propositions (3.5) and (4.3) together imply that when the measure 6(A)|c(A)| _2 <iA is associated 
with a* /W then the polynomials p n (X), n e A, are orthogonal. When reference is made to the 
orthogonality of these polynomials it is understood to be with respect to this measure. In this section 
and the next we will derive the recurrence and difference formulas for the orthogonal polynomials 
p n (A). In most cases, our method will be to prove our formula first for A in a certain integral cone 
where we can easily deal with the equations. To pass to the general formula we then need the 
following elementary result, which can be easily proved by induction. Recall the lattice A defined in 



(2.15) 



Lemma 5.1. Suppose pi(X) and P2(A) are two polynomials in a£. Let [i £ aj. Suppose that 
Pi (A) = j>2(A) for all A = n + fx, n e A. Then pi(X) — P2(A) for all A £ a£. 

To simplify certain arguments we assume, in this and next section, that v is an even positive 
integer. To state our result we need the binomial coefficient 

n \ a yj n k - nj + f (j - k - 1) 

(c.f. iQ). Note that ( n n Jk ) is actually a rational function of n and can be defined on all C" with 
singularities on some lower dimensional hyperplanes. We let 

-pr nj-rifc-fCj + l-A:) 

ai ) ~f} k »*-»*-!C*-*) • 

The following theorem is essentially proved in p0| , although the holomorphic discrete series ~k v is 
realized there in a degenerate principal series representation. We will not reproduce the same proof 
here. In the case of G = SU(1, 1) we have ip m (z) = z m . This theorem and the lemma that follows 
are generalizations of the simple facts that 



1 

1 



z m = -{v + m)z m - 1 + mz™- 1 



*»(-( I -1 ))^ m = (^ + 2m)z"\ 



which can be verified by a simple calculation. 

Theorem 5.2. Recall that £ = Ad(7)(— 2Zq). In the bounded realization Ti. u (T>) of the representa- 
tion of %c, 

r ( n \ r a 

(5-1) Kui-Olpn = [ n ^^-)^ n -^ ~ J ^2( V + n J - 1 )) C nO')V'n+ 7j 

3=1 ^ 1]/ 3=1 

Remark 5.3. As is proved in |20| one may use the above formula to derive the results of Faraut- 
Koranyi || on the norm of <f) n in the Hilbert space H. V {V). Conversely, knowing that 7r„(£)0A is of 
the above form, it is possible also to find recursively the coefficients by using the results in ||, the 
dimension formula in pfij] and the fact that 7r„(£) is a skew-symmetric operator. 

The element 2Zq = D(e, e) is in the center of £, and thus acts on each ifj n by a scalar. A routine 
calculation gives the following lemma: 

Lemma 5.4. We have 

(5.2) -K v {-2Z Q )tp m = {rv + 2|m|)V> m . 
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We can draw several important relations from these facts. Recall first from Theorem 2.9, part 5 
that 

q m>v {z) = A(z + e)-> m ((z - e)(z + e)" 1 ) = 2™/ 2 7^(7)^(2) . 
Recall that 77^(7) is well defined and that 

77„(7KW = 7r v (Ad(7)X)7r I/ (7) 



for all X e flc- As Ad(7 _1 )(2Z ) = £ and Ad(7 _1 )(£) = —2Z , by Lemma |^4| we get by applying 
the Cay ley transform to fl5.l|) and ( |5.2| ): 

Lemma 5.5. Lei q m ,v{z) = A (2 + e) _l/ ?A m (iz — e)(z + e) _1 ) i/ien i/ie following holds: 
1- 7r„(£)g mi! , = (ri/ + 2 |m|)g m , v . 

2. 7T l/ (-2Z )g m ^ = ^5=1 ( m m 7j )?m- 7j ,, - Ej=lO + n J - f (J - l)))CmO')gm+ 7i)1 /. 

The following theorem gives the recursion relations for the polynomials Pv^m- 
Theorem 5.6. The following recurrence formula holds: 



(2^(iA J -+p J -)Km(A)=^ 

3=1 3=1 

Proof. We prove the result for 
(5.3) 



m + 7j 
m 



P^,m+ 7j - (A) - {y + m.j - 1 - -(j - l))c m _ 7j {j)Pv, m - 7j (A). 



A = -i(m+ - -p), 



where m € A and § is viewed as |^ =1 /3j. The general result for A 6 C r = a J follows from Lemma 



5.1 



As Ad(7)^ = — Ad(7) -1 ^ = 2Zq we get from Lemma 



5.5 



Now simplify this expression before actually performing the differentiation: 
(5.4) 7r„(7-> m (ar) - 2"V a ^ A(e - x)~" 



e + x 



2™ /2 Vr 



e — a; 
e + x 
e — x 



A 



e + x 



e — x 

2 



A(e - x) 



A{e-x 2 ) 



2 rl/ / 2 (j> x (x)A(e-x 2 Y 



Here we have used that 



A 



e + x 



e — x 



-v/2 



Hence 
(5.5) 



A(e - x)~ v = A(e + x)-^ 2 A(e - x)^ 2 A(e - x)~ v 

= A(e + x)-» /2 A(e-x)- u/2 
= A(e-x 2 y^ 2 . 



n v (0(A(e - x 2 )-»/ 2 Mx)) = -(™ + 2|m|)A(e - x 2 )^ 2 ^) • 



On the other hand, by Lemma I4T 
(5.6) 



(j)x{x)A{e-x 2 ) S = ^p n (A)V„(a;). 



n£A 



Thus ( |5.5| ) reads 
(5.7) 



7T W (0 J2 = -( ri/ + 2 H) I] Pn(A)^„(x) 

n£A n6A 
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Notice that (5.6) is the power series expansion of an analytic function and the operator 7r„(£) is a 
differential operator; it commutes with the summation. We thus have, in a neighborhood of x = 0, 



(5.8) 



p„( A K(£)V>n(z) = -{rv + 2|m|) ^ Pn(A)^>„(z). 



neA 



neA 



The left hand side, in view of Theorem 5.2 



J^PnW EL " . Wn-^fc) -53^ + rl i ~ 1 )) c n(j)V , n+ 7i (a ; ) 



7j 



(5.9) 



= E ( E ( n t ^ W - + ^ - 1 - |0' - !))^ (J)P»- 7J (A) I 

neA \j=l ^ ' / 



Equating the coefficients of ijj n (x) in ( |5.8j ) and ( p.9| ) we get 

(ri/ + 2|m|) Pn (A) = £ + 7j )p„ +7j (A) - (i/ + n,- - 1 - ~(j - l))c„_ 7j (j)p n _ 7j (A). 



The relation ( |5.3| ) implies that (n/+2|m|) = 2|iA+p| = 2^'. 1 (iAj+ j Oj). This finishes the proof. □ 



Example 5.7. If 2? is the unit disk, then we can take 2?k as the unit interval (— 1, 1) on the real 
line. The spherical function on the unit disk is <j>\(x) = (yrf ) lX and the expansion ( [4.2] ) reads 



(5.10) 
with 



1 + x 
1-x 



(1- x)~ *-**(! + x) 



Ep»^( a ) x " 



?w(A) = (- + iA) n2 Fi(^ - i\, -n; -- - i\ - n + 1, 1) 



1 

1 



on functions on 



being the Meixner-Pollacyck polynomials, (c.f. Q). The action of £ : 
(-1,1) is 

w 1/ (0f(x) = vxf(x)-(l-x 2 )f'(x). 
Writing the function in equation ( 5.1 0| ) as G Uj \(x) we have 

This can be proved easily by a direct computation. It exemplifies equation ( [5.5] ) (Here, p = and 
so iX = m + §). It then implies the recurrence relation, 

(2iA)p„,„(A) = (n + l)p„,„+i(A) - [y + n - l)p„,„_i(A), 



and this coincides with Theorem 5.6 



Remark 5.8. While deriving the recurrence formula we have extended the action of Qc and 7 on 
Ti. v (T(fl)) (or TL U (D)) to the s pace of meromorphic functions on V. Indeed the operator 7r zy (7 _1 ) is 
up to a constant, c.f., Lemma |2.11 , a unitary operator from 7i„(T(fi)) onto H. V (T>) so it is initially 
defined on 7i v {T(Vl)), However, in our formulas the action of 717 (7 -1 ) on ipx for A = m is viewed as 
the extended action since ip\ is not an element in H„(T(f2)). It suggests some interesting applications 
of the idea of extending holomorphic functions on a domain to meromorphic functions to a larger 
domain. 
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6. Difference formulas for the Branching coefficients 
In this section we state and prove the difference equation for the polynomials p u ,m(X) 
Theorem 6.1. The polynomials p v m {X) satisfy the following difference equation 
-(ri/ + 2|n|)iJ 1/in (A) = 



iX + p 



Pi 



■(J - l)))CiA+p-S (j'K,n(A - ijj). 



3=1 



Proof. As in the proo f of Theorem 5J3| it suffices to prove the theorem for those A satisfying iX + p = 
m + v/2. Equations ( |5.5| ) and ( |5~6 ) in the proof above combine to give 



(6.1) 



2 2 7iv(7 1 )ljj m = Pn(A)^ n - 



n£A 



Let the operator n lJ (—2Z ) act on both sides. For the left-hand side we use Theorem 5.6, Lemma 
2.4, and equation ( |6 . 1| ) applied to the case z(A ± ijj) + p = (m =p 7^) + | to obtain 

LHS = 2^^(-2Z )^( 7 - 1 )V' m 
= 2^7r„(7 _1 )7r I ,(0V'm 

m 

m - 7^ 



-2^7T I ,( 7 - 1 )(^ 



m-7j 



^(1/ + mj - -(i - l))c m (j)Vw 7j ) 




Pn(A + iT,-) - ^(^ + mj - -(j - l))c m (j) Pn (X - V* 



3=1 



For the right-hand side we obtain by Lemma 

RHS = ^(-2Z )^ Pn (A)V„ 



n£A 



^(r^ + 2|n|)p n (A)^ n 



n£A 



The proof is completed by equating the coefficients, rewriting each occurrence of m in terms of A, 
and then applying Lemma 5.1. □ 



Example 6.2. We continue the Example 5.7. The above difference relation can be proved by simple 
however tricky computations, which in turn reveal the advantage of using the representation theoretic 
method. Using the notation there, write G\(x) — G u , x (x) the generating function. Differentiating 
the expansion we get 



(6.2) 



2x—G\{x) = 2np n ,u(Xyj 



On the other hand, differentiating the formula for G\(x) results in 
(6.3) 

We observe that 



2x^G x (x) = ( V - + l \)-^- Gx - l {x) + {— + i\)2E-G x+i {x). 



1 — X 1 ~\~ X 

G\{x) = — — G X -i(x) = G x +i(x), 

1 + x 1 — X 

which then imply that 
(6.4) 

v Gx{x) = (| + iX)G\(x) + - iX)Gx(x) = (| + iX)^G x ^(x) + (| - l \)\±^ G ^ l (x) 
2 2 2 1 + a; 2 1 — x 

Summing the equations fl6.3|) and (6.4) gives 



(2 X JL + v )G x {x) = + iX)G X -i{x) + - iX)G x+i (x) 
ax 2 2 
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and consequently 

(2n + v)p v , n {\) = (- + i\)p v ,n{\ - i) + (- - iX)p^ n (X + i) 

or 

-(2n + ^)^,„(A) = (-- + zA)p„ i „(A +i) - (- + iA)p^„(A - i) 
which coincides with Theorem 6.1. The proof of Theorem 6.1 is thus conceptually clearer. 

7. The restriction Principle in the unbounded realization 

In this section we discuss the application of the restriction principle to the unbounded realization 
of G/K. In particular, we use this to introduce the Laguerre functions of the cone fl and derive 
some relations they satisfy. For a function F defined on the Siegel domain T(fl) = ti + ij let 

R„F(x) = RF(x) = F(x) , 

where x E fl. Since the functions in Ti1(T(il)) are holomorphic it follows as before that R is injective 
on nl(T(n)). For jgO, let k y {z) = K v {z,y) = K{z,y), where z S T(O). Then k y e H v (T{Vl)) 
and 

Rk y {x)=T n {v)A{x + y)- v . 
Lemma 7.1. The linear span of {k y \ y S 51} is dense in 7i„(T(51)). 

Proof. Assume that / S TL v (T(p)) is perpendicular to all k y , y S 51. Then f(y) = 0, for all y e 51. 
As / is holomorphic it follows that / = 0. □ 

Recall the Beta-function for 51: 

B Q (u,fj,)= f A(x + e)-»-»A(xy- d / r dx, 

which is finite for v and \x having real parts greater than (r — 1)| (j?J], p 141). 
Lemma 7.2. Let y e Cl. Then Rk y £ L 2 v (Vl), for all v > (r - 1)|. In fact 

Proof. Let y £ 51. Then, performing the change of variables x i— > Q(y^)x where Q is the Jordan 
quadratic operator in the section 2.1, 



Rk v f = TUv) I , A2 „ dx 



n A(x + y) 2 » 
1 /■ A(x)' y - d /' r 
A(^ J n A(x + ey 



r^(^ / A ,_, .^ ds (*-Q(i/*)s) 



= A(^ ( ^ )<00 ' 

finishing the proof. □ 

We need to distinguish the Laplace transform £„/ as mapping on functions on 51 to itself and as 
mapping functions on 51 to holomorphic functions on T(51). We write the former as £^}f, which is 
the restriction of the latter. 

Lemma 7.3. Let v > (r — 1)§. T/ien the set {Rk y | z/ € 51} is dense in L^(51). 
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Proof. Let / £ L^(£l) and suppose / is orthogonal to all Rk y , y 6 ft. Then 

= (/ | Rky) 

= r n (i/) / /(a;)A(a; + |/)-"A(i)"-'/'-di 



= / /(x)£ I ,(e-^l-))(x)A(x) ,y - d / r da; 
e" (! 'l x) £^(/)(a;)A(a;)''-' 1 /'- da; 



'n 

= £?(£?(/))(y). 

From this and the injectivity of the Laplace transform it follows that / = 0. □ 

By the previous lemmas it follows that the restriction map 

R:H v (T(Q))->Ll(Sl) 

is injective, densely defined and has dense range. Since convergence in W„(T(f2)) implies uniform 
convergence on compact sets it follows easily that R is closed. We can thus polarize R*, R* — U\R*\, 
and obtain a unitary map U from L^(f2) onto H v (T(tl)). We now prove that U = C v . 

Theorem 7.4. Suppose v > §(r — 1). The polar decomposition of R* is given by R* = C U C^ , where 
the operator £ i, extends to a unitary operator from L^(fl) onto H%{Tq). 

Proof. Denote temporarily C n = £„. We define C on the domain 



{feLl(Q): [ e-^f(x)dfi v (x)eLl(n)}. 
Jo, 



Note that by Cauchy-Schwarz inequality the condition / e L*(Q,) implies that C f is a well-defined 
function on Q since e~( v ' x > for fixed y £ fl is a function in Z/^(f2). It is then easy to prove that C n 
so defined is a self-adjoint positive operator. Let / £ L^(U) be in the domain of RR* , then 

RR*f(y) = R*f(y) 

= (R*f | fcy)w„(T(Q)) 

= (/ I R k v)Ll(n) 



f(x)K(x,y)dfi 1/ (x) 
(7-1) = r n (i/) / /(x)A(x + y)-" d^z) 



e~^ x) k{xy- d / r C n {f){x)dx 



n 

C n (C a f)(y), 



and 



(L Q f,C n f) = (R*f ) R*f)<cx>. 

Thus / is in the domain of (£°) 2 and RR* — {C n ) 2 , since (£ n ) 2 is a self-adjoint extension of 
which is also self-adjoint by the von Neumann theorem (see e.g. [ pH , VIII. problem 45.) 

Consider the inverse operator acting on the image of R. For a function g in the image of R, 
R~ x g is the unique extension of g to a holomorphic function on T(f2). Thus = £„. Let i? -1 

act on the previous equality (7.1) 

R*f = C u C n f. 

This proves the polar decomposition formula. Since R* is densily defined and R is an injective closed 
operator we have that the unitary part C v extends to a unitary operator. □ 
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Remark 7.5. The multiplication map f(x) — > A(x)% f(x) induces a unitary isomorphism between 
L%(n) to L 2 (£l, dfi ). In turn, L 2 (f2, d/i ) is unitarily equivalent to L 2 (2?r, drj) via a scalar multiple of 



the Cayley transform. This is likewise true for 7i„(T(f2)) and 7i„ (T>) (see Lemma 2.11). Furthermore, 
these isomorphisms intertwine the corresponding restriction maps. It follows then from Theorem 3.3 
that R is a continuous operator for v > a(r — 1). 

Corollary 7.6. Assume that v > l + a(r— 1). Then : H 2 {T(£l)) — > L 2 (Q) is given by the integral 
operator 

C* v F{x) = a u [ F{z)e~^ x) A{yY~ 2d/r dx dy 

JT(Q.) 

where ol v = ^) d T n {v-d/r) • 

Proof. Write C for C u . Let F e Hl(T{Q)) and / e L 2 (ft). Then 
| /) = (F | Cf) Hl{T{a)) 

= a v [ F(z)£f^)A( y y~ 2d / r dx dy 
JT{n) 



a v / F{z) / e-(*l*) f(t)A(t)"- d / r A{yf- 2d / r dtdxdy 
Jt(q) Jn 



a,. 



F(z)e-M*) A{yY~ 2d ' r dxdy f(t) d^{t). 



□ 



Using the Laplace transform we transfer the G 7 -action, tt v , on 7i 2 (T(f2)) to an equivalent action, 
denoted by \ U: on L 2 (fl) and notice the following simple fact: 

Lemma 7.7. The H 1 -action on L 2 (fl) is given by the formula 

X l/ (h)f(x)^Det(h)pf(h t x), 

where the determinant is taken as a real linear transformation on J and h l denotes the transpose 
with respect to the real form (x \ y). 

Proof. For h E H 1 a straightforward calculation gives that J(h,z) — Det(h) and dp, v (hx) — 
Det(/i) ± ? 1 d/i u (x). Thus, for / 6 L 2 (Vl) we have 

7r u (h)C v f(z) = J(h-\z)^ [ e-( h ~ lz Mf(x)d[i„(x) 

Jn 

= Det(h)-% [ e'^ x) f(h t x)d^(h t x) 
Jn 

= Det(h)^C v (foh t )(z). 
This calculation now implies the lemma. □ 

We follow fj\, p. 343, and define the generalized Laguerre polynomials by the formula 



|n|<|m| 



and the generalized Laguerre functions by 
By Proposition XV. 4. 2 in 0, p. 344, we get:. 

Theorem 7.8. The Laguerre functions form an orthogonal basis of L 2 (Q) L . Furthermore, 

£„(C)=r n (m + i/)c. 
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Let E be the Euler operator on Vt (or V). Specifically, 

Ef(x) = ^/(te)|t=i = ^/(exp(tZ ) • x)\ t=0 . 
We now obtain the following recursion formula. 

Theorem 7.9. The Laguerre functions are related by the following recursion relations 

2Et m = -< - E ( m m 7 .) K - 1 + " - (i - !)^)C- 7J + E Mi)C +7J 



Proof. By Lemma 7.7 the _ff 7 -action is given by 

\„(h)f{x) =det[h)^f[h t x) 



The infinitesimal action is then given in the usual way by differentiation. Thus by Lemma 2.2 
Z E h 7 and Z acts on the smooth vectors in L^(Q) by : 

\„(Z )f(x) = (^- + E)f(x). 



According to Lemma 5.5 , part 2, we have 



-^( 22 o)v. = E (m"^ j 9m - 7 J^ ~ E^ + m ' ~ 2^ ~~ 1 ) Cl »W) 9m +ii."- 



j=l v j=l 

The inverse Laplace transform of the above equation gives 



2^ _|_ J7]\ _ 

2 + m) ~~ ^ V m - 1iJ r(z/ + m - tj) 



This simplifies to 



-2(y + = E ) imj-l + u- (j l)^)C- 7j ~ E c -(i)C +7j! 

3=1 V J/ 3=1 

and proves the theorem. □ 
In the above Theorem we used the action of Zq, but to directly derive a d iffer ential equation 



satisfied by the Laguerre functions one uses the element £ and part 1 in Lemma 5^5 
Remark 7.10. If the Laguerre polynomials were defined by the formula 

l<M 



it would agree with our definition given in 0. With this definition the formula in the proceeding 
theorem would become 

2£°c = -^°c - e ( m m 7j ) + - 1 + v - (j - ijf^orc^- 



Remark 7.11. Theorem 7.9 involves both a creation and an annihilation operator, i.e., it involves 



both a step uprn-^n + 7 3 and a step down n i— > n — 7,-. This is related to the fact that the element 



Zo S 3(f)) which is used to derive the relation in Theorem 7.9 has a decomposition £ = E + + E_ into 
H 1 invariant element where E+ is in the p 7+ and steps down and E— is in p 7 ~ and steps up. The 
elements E+ and E- are not in f)I and hence they act as a second order differential operator. In 
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the case of the upper half-plane (in particular, see Proposition 2.7 and Theorem 3.4 in [0 where we 
are using K + iM. + as a realization of the tube domain) this corresponds to 

"Ol\_l/-il\ 1 / i 1 
1 / 2 I 1 ^ / + 2 I 1 -1 



and 



| ( !* ))^^{tD 2 + {2t + v)D + {t + v) 
Furthermore, one can in a similar way get a differential equation satisfied by the Laguerre 



functions by applying the Cayley transform to part 1 in Lemma 5.5 

7iv(£)Pm,!/ = (ru + 2 |m|)p miJ/ . 

This equation is also a second order differential equation, which in the case of the upper half-plane 
is 

{tD 2 + uD-t)t n = -{u + 2n)t n . 

All of these equations can be caried over to the general case to find the radial part of the corre- 
sponding operators. We think that it is an interesting problem to find an explicit formula for the 
raising operator, annihilator operator and the operator 7r„(£), in the general case. 
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